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INTRODUCTION 


I lie  problem  of  equalizing  a channel  whose  channel-correlation  matrix  has  a large 
eigenvalue  spread  is  well-known.  Adaptive  gradient  algorithms'  “ are  among  the  simplest  to 
implement,  hut  the  rate  of  convergence  (ROC)  of  these  algorithms  is  determined  largely  by 
the  ratio  ol  the  maximum  to  minimum  eigenvalues  of  the  channel-correlation  matrix. 
Alternative  algorithms  have  been  proposed  which  orthogonali/e  the  above  matrix.  In  parti- 
cular. OodauH  through  application  of  Kalman  filter  theory,  has  derived  an  adaptive  sell 
orthogonali/ing  algorithm  which  has  extremely  rapid  convergence  properties.  As  discussed 
in  Reference  5,  the  Oodard  algorithm  involves  estimating  the  inverse  of  the  channel- 
correlation  matrix  through  an  iterative  matrix  equation.  Even  though  theCodard  algorithm 
converges  rapidly,  the  number  ol  operations  per  update  for  this  algorithm  depends  on  the 
square  of  the  number  of  equalizer  taps,  which  creates  implementation  difficulties  for  large 
length  equalizers,  (iitlin  and  Magee-*'  have  proposed  an  adaptive  self-orthogonali/ing 
algorithm  which  provides  a compromise  between  computational  complexity  and  speed  ol 
convergence.  This  algorithm  consists  of  approximating  the  inverse  ol  the  channel-correlation 
matrix  by  a Toeplitz.  matrix  and  involves  only  one  matrix  multiplication.  Reference  5 
presents  a comparison  between  some  ol  the  different  adaptive  orthogonali/ing  algorithms. 

A relatively  new  class  of  adaptive  algorithms  also  provides  self-orthogonali/ing 
capabilities  and  only  requires  a number  of  operations  per  update  that  depends  linearly  on 
the  length  of  the  filter. ^ -7.8,9. 1 0,1  I These  algorithms  are  called  adaptive  lattice  (AL) 
algorithms  and  generate  a set  ol  orthogonal  signal  components  which  can  be  used  as  inputs 
to  equalizer  gain  controls.  These  components  are  generated  through  a (iram-Schmidt  type 
ol  orthogonali/.ation.^’'OJ  I these  AI.  algorithms  have  been  proposed  for  use  in  such  areas 
as  speech,  sonar  signal  processing,  noise  cancelling  and  parameter  estimation/*’^’^’1^' ' 
and  Makhoul  in  References  10  and  1 I has  suggested  they  be  used  also  in  adaptive  equaliza- 
tion. I bis  report  examines,  via  computer  simulation,  the  performance  of  AL  algorithms 
as  applied  to  channel  equalization. 


ADAPTIVE  LATTICE  EQUALIZATION 

As  pointed  out  in  Reference  5,  the  main  component  in  the  majority  ol  adaptive 
equalization  algorithms  is  the  estimated  gradient  tap  adjustment  algorithm.  This  is  true 
also  for  the  AI.  algorithms  examined  in  this  report  and,  therefore,  we  present  a brief  review 
of  the  estimated  gradient  algorithm. 


ESTIMATED  GRADIENT  ALGORITHM 

The  estimated  gradient  tap  adjustment  algorithm  is  given  by: 


('n+l  =(’n-%cnXn  <•> 

In  Equation  I.  ('n  is  the  N-length  vector  representing  the  n-tli  iteration  estimate  of  the 
optimum  (minimum  mean  square  error)  N-tap  equalizer; an  is  a positive  parameter  denoted 
as  the  step  size;e  is  the  instantaneous  difference  between  the  equalizer  output  ( y f) ) and  the 
value  of  the  transmitted  data  symbol  (an);and  Xn  is  the  N-length  vector  of  received  data 


samples  ir  the  equalizer  delay  line  at  the  n-th  iteration.*  The  components  of  Xn  will  be 
denoted  as  | Xn  | ^ where  k = 1,  . . N.  The  received  data  samples  xn  are  given  as 

the  superposition  of  a corruptive  white  noise  sequence  w()  and  the  output  of  a linear  channel 
filter  h:  operating  upon  the  transmitted  data  symbols: 


<n=  E 


an-i  hi  + wn 


(2) 


In  Equation  2,  the  hj  represent  the  channel  impulse  response  and  the  noise  sequence  w()  is 
defined  to  have  a variance  a~. 

The  convergence  properties  of  Equation  1 have  been  studied  by  a number  of 
authors^  * “ under  different  assumptions  concerning  the  dependence  of  «n  upon  n.  In 
many  applications  of  Equation  I to  digital  adaptive  equalization,  cxn  is  held  constant-3  and 
Equation  1 becomes  the  familiar  least-inean-squares  (LMS)  algorithm.  As  n -»<».  the  mean 
weight  vector  converges  to  the  optimal  tap  vector  given  by 


lim 


FTC  n)  CQpt 


(3) 


where  FT*)  denotes  expectation  and  CQpt  is  the  optimum  weight  vector  given  by  the  dis- 
crete Wiener  matrix  equation 

Copt  = A",B  <4) 

In  Equation  4,  A is  the  N X N positive-definite  Toeplitz.  channel  correlation  matrix 

A = E(XnX^)  (Sj 

and  B is  the  N-length  vector 

B = E(anXn)  . ((,) 


As  the  tap  vector  evolves  according  to  Equation  I . the  mean  square  error  tint  evolves  as 


tin)  eopt  + opt  ~ ( n*  opt  ( n^ 
where  e()  , is  the  minimum  mean  square  error  (MMSE)  and  is  given  by 


(7) 


€opt 


( 


opt 


(Xj 


It  is  assumed  the  data  symbol  sequence  is  uncorrelated  and  has  unity  power. 

As  diseusseil  in  References  3 and  5,  the  convergence  of  e is  strongly  dependent 
upon  the  ratio  R of  the  largest-to-smallest  eigenvalues  of  the  A matrix;  i.e.,  R = A,„.JV/A, 

I here  fore,  large  values  of  K (heavy  channel  distortion)  can  lead  to  excessively  long  conver- 
gence  times  when  Equation  I is  used  to  update  the  (.'  Basically  this  is  because  the 
components  of  Xn  generally  are  not  orthogonal.  This  implies  that  premultiplying  the 
estimated  gradient  (cnXn)  in  Equation  I by  A-'  (or  an  estimate  ol  A-* ) potentially  will 
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•In  (Ins  report  we  will  consider  only  the  training  part  of  equalization  when  the  transmitted  data  symbols 
are  known  at  the  receiver 
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offer  a significant  time  improvment  in  the  convergence  ol  Equation  1 . I Ins  approach  is 
employed  in  the  algorithms  ol  ( iodard^  and  ( iitiin  and  Magee 5 and  Chang  1 ^ has  suggested 
transforming  X()  to  a new  vector  / with  orthonormal  components.  Unfortunately,  these 
algorithms  have  computational  and/or  storage  requirements  which  grow  as  the  square  of  the 
number  of  equalizer  taps 


ADAPTIVE  LATTICE  ALGORITHMS 


As  an  alternative  to  the  self-orthogonali/ation  algorithms  discussed  previously. 
Makhoul  * ,J  ' * has  suggested  the  use  ol  AL  algorithms  for  adaptive  equalization  ( oven  an 
equalizer  input  sequence  x|r  the  AI.  algorithms  generate  an  orthogonal  set  ol  signals  which 

will  be  denoted  as  bm(n),  where  m = 1 N.  Although  a number  ol  AL  algorithms  have 

been  proposed  1^-1  * for  performing  this  ortltogonalization.  concentration  will  he  directed  to 
the  basic  lattice  structure  shown  in  Figures  I and  2.  This  particular  lattice  structure  was 
originally  proposed  by  llakura  and  Saito'5  for  performing  speech  analysis.  I he  ortho 
gonalization  of  X ( is  done  in  this  lattice  through  the  recursions 

b|(n)  = fj(n)  = x (da  I 

»m+l,n,  = ,m,",-Km  hn,(n  “ 1 ' (9b» 

bm+l(n>  = ~Km  fm(n)  + bm(n-  ])  (9c) 


where  m = I N-l  I he  fm(n)  and  bm(n)  in  Equation  9 are  called  the  forward  and 

backward  error  residuals  ol  the  lattice  • • ■ • 14  .respectively  .and  then  properties  will  be 

discussed  presently.  The  K in  I quation  9 are  known  as  the  reflection  coefficients  and 
may  be  determined  by  a number  of  methods*^  which  produce  identical  results  when  x is  a 
statistically  stationary  sequence  file  method  used  lor  choosing  the  K.,,  in  this  report  was 
originally  proposed  by  Burg ' and  consists  ol  minimizing  the  sum  of  tiie  variances  ol  the 
backward  and  forward  residuals,  denoted  as  l.<l~)+|(n))  + Efb-^  |(nf),  with  respect  to  K|(  . 
file  result  lor  the  K()|  is  given  by 


2 F.( !,„(">  b|n(m  - I )) 
E(f2,(n))  + E(b,2n(n  -If) 


I < m < N - 1 


(10) 


As  discussed  in  References  6 through  I I and  14  and  15,  when  x()  is  stationary  the 
residuals  b|n+|(n)  and  l||)+  j ( n > in  Equation  9 are  equivalent  to  the  backward  and  forward 
error  residuals  of  an  m-point  I -step  linear  prediction  filter.  I hat  is. 


m 


in+ 1 


<n)-xn_m“  X)  Wj'1’!  xn_|T)+j  ( l<m<N- 


J=l 

m 


*m+l,n)  xn  " ^ % * xn-j  , l<m<N-l 

i=l 


( I la) 


(lib) 
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M 
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figure  1 Basic  lattice  structuie. 


figure  1 The  m-ili  st aj>c  ol  the  basic  lattice'  structure. 


where  the  W-m*  are  the  I -step  predictor  coefficients  obtained  from  the  normal  equations'  ^ 
in 

^ wjtn>  0(p  - j)  = 0(p)  . I<p<m  . (12) 

j=l 

In  Equation  12.  0(p  -j)  is  the  p.  j-th  element  of  the  channel  correlation  matrix  Given 

the  basic  orthogonality  property  ol  MMSI.  residuals,  namely, 

I (Xn-j  bm+i(n))  = 0 , 0 <j<  in- I , (13) 

it  is  easily  seen  from  Equation  I la  that 

| 0 , j =£  m 

E(bn)(n)  bj(n))  * ) em  , j = m = 2,3 N (14) 

^ E(x“i  , j = m = I 

where  < , +j  represents  tlie  MMSI.  of  an  m-point  1-step  linear  prediction  filter  Therefore, 
the  bm(n)  represent  a set  ol  N orthogonal  signals  which  can  now  be  used  as  the  inputs  to 
equalizer  gain  controls  * However,  it  remains  to  be  seen  how  the  lattice  algorithm  ol 
Equation  'l  and  Equation  10  can  be  implemented  adaptively. 

*lt  should  he  noted  that  an  additional  set  id  N oithogonal  signals  (n  + m - N),  where  m I . . N - I , 

is  also  available  troni  the  lattice  algorithm,  as  can  be  seen  by  using  a similai  argument  as  that  winch  led  to 
Equation  14. 
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WV  will  use  Ills'  algorithm  below,  proposed  by  Maklioul.  ^ ' which  is  a niodilica 

W 

bon  ol  Hie  \l  ulgonihm  presented  by  ( .ninths  Specifically,  k in  I <|ualions  ')  ami 
IH  is  replaced  by  k|M(  ni  and  updated  according  to  the  lollowinjj  adaptive  algurillmi 


In  I quation  I 5.  u is  the  normalized  step  si/e  ol  the  adaptive  algorithm  and  is  restricted  to 

U • or  < 2 lor  stability  * Also,  (i.^.(n)  is  the  n-tli  iteration  estimate  ol  the  sum  I ,<  I n.( n I > 

111 

f 1(1)-^ i)  - 1 )).  1 la*  n ) arc  updated  as  follows: 

■>  ■»  i ->  i i 

o-,(n|  (I  - or)  o-jtn  - I I + o | l“)<n>  + h n - 1 1 , , 


I < in  < N - I 


(lb) 


I <| nations  ').  1 S and  I (>  are  the  A I algorithm  which  provides  the  orthogonal  signal  compo- 
nents b|M(  n I ( liven  the  backward  and  forward  residuals  at  the  n-tli  update.  Kn)(  n+  I ) 
is  computed  from  I quations  I 5 and  lb  I he  backward  and  lorward  residuals  at  the  (n+l  i-sl 
update  are  then  computed  from  I quation  using  the  updated  reflection  coel  licients 
kM|( n+l  I and  so  on 

Fquations  15  and  l(>  provide  noisy  estimates  of  the  optimal  K|n  values  as  given  by 
I (juation  10  I he  variance  ol  these  estimates  is  reduced  as  o -*  0 (which  also  results  in  an 
increase  in  the  convergence  time  ot  liquations  I 5 and  lb).  However,  due  to  the  successive 
orthogonali/ation  which  is  intrinsic  to  the  lattice  structure,  it  is  expected  that  the  conver- 
gence rate  ol  I quations  I 5 and  lb  will  not  be  limited  by  the  ratio  R.  as  is  the  case  with 
I ((nation  I I Ins  is  indeed  displayed  by  simulations  presented  m the  next  section. 
Stimulation  Results 

Let  us  examine  two  specific  adaptive  algorithms  for  estimating  the  MMSI  eqi.ali/er 
tap  coefficients.  I he  first  algorithm,  illustrated  in  Figure  3.  has  recently  been  proposed  by 
( iriffiths^  and  is  given  by 


v , (II ) an  - c;  J (n ) b J < n ) , (17a) 

Vm(n,=  Vm-l(n)  ~(im(n)  'V11*  > 2 < < N (17b) 

fhe  tap  coefficients,  (i  (n)  . are  updated  according  to: 

(;m(n  + I ) = (im(n)  + — — — Vm(n)bm(n)  , I < m < N , (IXa) 

7,Vn> 

;;  • I - a ) 7,“n<n  - I ) + arb2n(n)  , I m < N . ( 18b) 
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9 

Figure  3 Adaptive  laltice  algorithm  ol  (irillitlis. 


As  discussed  in  Reference  the  sequence  V())(n)  represents  the  output  error  se- 
quence ol  ;m  m-tap  equalizer.  Therefore, 

Vm(n>  = an-ynm)  • ,|9» 

where  yj"1’  is  the  output  sequence  of  the  m-tap  equalizer.  Note  that  the  value  7~u<n)  is  the 
n th  iteration  estimate  of  the  power.  l-.(b*^(n)),  of  the  orthogonal  signal  component  h|n(ni 
I Ins  component  is  fed  directly  into  the  in-tli  equalizer  tap,  C»m,  as  shown  in  Figure  .V 
(iriffiths  y points  out  that  the  convergence  rate  of  the  overall  AL  algorithm  (represented  l>y 
I, (Illations '.)  and  I 5 through  1 8 ) should  be  relatively  insensitive  to  the  eigenvalue  ratio  K , 
especially  when  compared  to  fquation  I This  observation  is  valid,  evidenced  by  the  results 
of  the  simulations  in  the  next  section. 

A second  adaptive  algorithm  for  adjusting  the  equalizer  taps,  suggested  by 
Makhoul. 1 ,J  ‘ ' is  illustrated  in  figure  4 I Ins  algorithm  is  given  by: 

N 

VN<»>  = *,,  - £ <>m  (n)bm(n)  , (20) 

m=l 

where  the  tap  coefficients  are  updated  according  to 

(,i„(n+l)  (*m(n) +-r^—  I VN(n)  bm(n)|  . (21a) 

?m,n) 

71“n(n)  = (I  - afy-jtn-l ) + ob-jtn-l ) . (21b) 

I < m < N 

As  can  he  seen  from  Equations  20  and  21  and  figure  4,  V^(n)  represents  the  error  output 
sequence  from  an  N lap  equalizer. 
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V 


figure  4 


Adaptive  ]a 1 1 u,e  algorithm  ot  Makhoul, 


10,1  I 


The  AT  algorithm  represented  by  Equations  9 and  15  through  18.  will  be  referred  to 
asAL)  and  the  AL  algorithm  represented  by  hquations  9.  I 5 through  16.  20  and  21.  will 
be  referred  to  as  AL2  The  main  difference  between  the  two  algorithms  is  that  in  AL1  each 
individual  error  sequence  (Vm(n)  for  m=l . ,N)  is  available,  whereas  AL2  only  provides 

the  N-tap  equalizer  output  error  sequence.  This  property  of  A LI . as  noted  in  Reference  9, 
makes  it  potentially  useful  for  purposes  of  determining  the  optimum  number  of  taps  for  use 
in  a time-varying  environment.  Specifically,  since  the  time  constant  of  the  overall  adaptive 
lattice  configuration  is  proportional  to  the  number  ot  stages.^  later  stages  will  have  larger 
time  constants  and.  therefore,  will  not  be  able  to  track  a highly  dynamic  input.  I Inis,  the 

sequence  of  error  expectations,  h { V“t (n ) ) for  m=  1 N.  will  have  a minimum  for 

some  m 

A number  of  other  properties  of  adaptive  and  fixed-structure  lattice  algorithms 
are  presented  in  References  8 through  I I . 


SIMULATION  RESULTS 

Results  ot  AL1  and  AL2  computer  simulations  are  presented  in  this  section  for  two 
channels  representing  heavy  distortion  (R  = 1 1 ,21 ) In  all  simulations  1 I -tap  equalizers 
were  used  and  the  symbol  sequence  a()  was  a random  sequence  of  bipolar  signals  (an  = i I ), 
suitably  delayed  so  that  the  optimal  taps  (given  by  Equation  4)  were  symmetric  about  the 
center  of  the  equalizer.  Also,  the  channel  impulse  response  m all  cases  was  the  raised-cosine 
pulse,  defined  by 

j Vi(  1 + cos  { 27t( i - N()  — 1 )/ %V } >,  I < i < 2N()  + I ( 22a I 

( 0.  otherwise  (22b) 

where  W m I quatmn  22a  was  varied  to  provide*  different  values  lor  the  eigenvalue  ratio  R 

I he  results  of  the  simulations  lor  the  two  different  c hannels  are  presented  in  f igures 
5 and  6 All  plots  were  generated  by  ensemble  averaging  the  squared  error  outpu*  'if  the 
equalizer  over  200  individual  learning  curves  f or  purposes  of  comparison,  the  gradient 
algorithm  of  Equation  I was  also  simulated,  for  the  gradient  algorithm,  the  step  size  was 
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LOG10  0F  0UTPUT  MEAN  square  error 


chosen  to  be  tv  0 0.1 . loi  the  hit  l ice  algorithms  tv  was  i hoseii  to  he  0.025  I x penmen  tut  ion 
has  shown  that  these  values  ol  tv  provided  a good  trade-oil  between  quick  convergence  and 
stability.  I he  initial  equalizer  tap  values  lor  each  simulation  was  the  zero  vector  In 
addition,  the  initial  values  lor  the  Kn|(n ) coefficients  in  I quation  I 5 were  zero,  and  the 
°iii< *) * 'in<*  '*u  7m* "I  WL'ie  initialized  to  unity 

I he  simulation  results  1 or  Al.  channel  equalization  ol  lugh  distortion  communication 
channels  are  shown  in  f igures  5 and  <>  Several  points  are  ol  immediate  interest  I list  the 
initial  convergence  behaviors  Al.l  and  AI2  are  faster  Ilian  for  the  gradient  estimation 
equalizei  and  ale  linear,  rat  her  than  ion  vex.  Second , tlieie  is  a not  livable  dll  leience  in 
the  steady  stale  MSI  level'  between  Al  I ( which  updates  the  ( •,(  n ) according  to  the  stage 
wise  errors  Vjtn  ))  and  A 1 .2  (which  updates  I lie  < >:(  n ) using  only  I lie  final  erroi  Vsjt  n It 
I liese  results  do  not  necessarily  establish  the  superiority  ol  All  ovei  Al  .2  loi  equalizer  uu 
pic-mentations  since  very  little  analysis  has  been  done  on  optimizing  the  latte  e and  equalizei 
parameters  However,  several  different  u values  were  used  m addition  to  the  one  used  lor 
figures  5 and  <>  and  a similar  reduced  MSI  value  resulted  liom  Al  l Anolhvi  uupoilunl 
result  is  seen  from  comparing  the  A 1. 1 curves  in  figures  5 and  b.  'Hie  A I I equalizei  con 
verges  loi  both  the  l<  I I and  l<  2 I channels  m approximately  equal  times  and  thus  exhibits 
the  eigenvalue  insensitivity  which  theory  suggests  I he  gradient  estimate  equalizer,  on  the 
other  hand  required  an  increasing  number  ol  iterations  to  reach  convergence  as  the 
eigenvalue  ratio  was  increased 


( <)N<  LIJSIONS 


In  tins  report,  the  application  ol  adaptive  lattice  algorithms  to  channel  equalization 
has  been  considered  Unlike  the  majority  ol  proposed  sell-orthogonalizing  algorithms,  the 
Al.  algorithms  only  require  a number  ol  operations  per  update  which  is  linear  with  respect 
to  the  number  ol  equalizer  taps  furthermore,  the  rate  of  convergence  ol  Al.  algorithms 
appears  highly  insensitive  to  Ihe  eigenvalue  disparity  ol  the  channel  correlation  matnx 
O'  Ihe  two  A I.  algorithms  investigated,  the  algorithm  All  which  minimized  the  stage 
wise  errors  ol  the  equalizer  possesses  a much  lower  steady-state  MSI  Ilian  tin-  algorithm 
AI.2  which  minimized  only  the  final  equalizer  error  I his  excess  mean  square  error  in 
steady  slate  may  be  attributed  to  Ihe  lact  that  the  equalizer  tap  cocllniciils  may  be  noisiei 
when  minimizing  only  the  final  error.  However,  at  present  this  relationship  is  not  well 
understood  and  is  an  area  lot  further  investigation 
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